In game theory, a Markov strategy is one that does not depend at all on state variables that are functions of the history of the game, except those that affect payoffs.
In other words: a player playing a Markovian strategy, conditions his action of a period t only at his state at this given period. The lack of dependence upon the history is known in the theory of stochastic processes as Markov property.